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ABSTRACT 



The Office of Institutional Research (IR) at Miami-Dade 
Community College (M-DCC) (Florida) offers the results of a survey regarding 
the use of the office's services. Instead of using hard copy format as in the 
past, the current survey was conducted online. An e-mail message requesting 
participation was sent to the 3,498 employees with e-mail addresses. The 
response rate was 9% (332 responses) , higher than the rate in any previous 
user satisfaction survey. In general, 42% of responses were received from 
staff, 31% from management, and 22% from faculty. Among full-time personnel 
at M-DCC, faculty comprise 30%, management 17%, and classified staff 53%. 
Using this as a guide, the survey determined that management personnel were 
much more likely to have responded to the survey. Results indicated that: (1) 

respondents were most familiar with IR publications (40% indicated they had 
received them); (2) 30% of respondents had visited the IR Web site; (3) 27% 
had requested special information or research from the IR office; (4) 
management respondents were most likely to have visited the IR Web site 
(53%) , while faculty were least likely (12%) ; and (5) 96% of respondents who 
were able to rate the accuracy of the information on the Web site agreed or 
strongly agreed with its accuracy. (Contains six tables, with the 2000-2001 
effectiveness plan and survey instrument appended. ) (NB) 
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Report on Users’ Satisfaction with 
Services Provided by Institutional Research 

Executive Summary and Conclusions: 

The Office of Institutional Research strives to provide excellent service to the College community 
as an information and research resource. As part of an on-going effort to assess the office, this 
user satisfaction survey was conducted to determine level of satisfaction with services provided 
and to gather suggestions for improvement. The results were overwhelmingly favorable for all 
three areas surveyed (reports and publications, web site, and special research requests). All 
received agreement ratings well above 90% for most dimensions. The results also support the 
effectiveness of recent strategies to become more responsive to the changing needs of the 
College and to utilize technology to a greater extent in disseminating information. Some excellent 
suggestions for improvement were made and will be addressed by Institutional Research. 

Conclusion: Survey results indicate that Institutional Research is doing a very good job of 

meeting the information and research needs of the College community. The survey results and 
suggestions will be used to formulate strategies to improve and modify services to keep up with 
the changing needs of the College. 



Introduction: 

The Office of Institutional Research strives to be a high-quality, service-oriented participant and 
contributor to Miami-Dade Community College. As part of an on-going effort to assess the effectiveness 
of the office and services provided, Institutional Research periodically asks its users to provide feedback 
on the service received. One of the primary purposes of Institutional Research is to serve as an 
information resource for the College - a purpose for which user feedback is invaluable to ensure that the 
service provided meets their needs. If Institutional Research is effective in fulfilling this purpose, the 
following can be expected: 

• Users will receive information that is accurate, meets their needs, and supports decision-making. 

• Research Reports, Information Capsules, Research Notes, and other publications will address 
issues that are relevant, timely, and objective. 

• The web page will contain information that meets or exceeds the routine data needs of the 
College. 

• Data for special requests will be provided whenever possible, and within a reasonable amount of 
time. 

While the Office of Institutional Research serves numerous other purposes, they are not as amenable to 
evaluation through College user surveys. Therefore, the current survey evaluation focuses on the 
information resource purpose and expected results listed above. 

An important, but less visible, role that Institutional Research fills is in meeting state and federal reporting 
requirements through the verification and submission of the Student Database, ensuring the accuracy of 
State Accountability and Equity Reports, and supplying data for IPEDS, Title III, Title V, College Board 
and other reports. 

In addition, Institutional Research captures data related to placements and outcomes in workforce 
education programs, such as OCRs, LCPs, and supplemental job placement information. Enrollment 
projections and monitoring are coordinated through Institutional Research. The administration and 
coordination of college-wide testing and student feedback programs through the Campus Testing 
Departments is also the responsibility of Institutional Research. Finally, the Office plays a key role in the 
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strategic Planning and Institutional Effectiveness processes at the College. The 2000-2001 Effectiveness 
Plan for Institutional Research details the many main purposes served by the office, as well as how 
achievement of expected results will be measured. A copy of the plan is included in Appendix A. 



Background 



The Office of Institutional Research has conducted user satisfaction surveys previously, most recently in 
1994 (R.R. 95-01 R) and in 1991 (R.R. 91-14R). Results from these surveys have provided valuable 
insight into the needs and perceptions of users and have prompted numerous changes. One of the 
changes was the assignment of an Institutional Research professional to each campus as a research 
liaison. This was done to increase campus access to services and ensure that issues addressed are 
relevant at the campus as well as the college level. 

While Institutional Research publications generally received high marks for readability in previous 
surveys, several new formats were adopted. The Research Note format, which is a brief report and 
receives limited, targeted distribution, is used to report special request information. Executive summaries, 
which precede reports and capsules to provide a quick overview of results, were added to facilitate 
access to and use of findings. 

In addition to changes made in response to survey results, the nature of the times has dictated a number 
of other changes. The Office of Institutional Research has become accustomed to responding very 
quickly to special requests and shifting priorities in keeping with the immediate needs of the College. 
There has also been considerable movement toward providing information electronically. Abstracts, 
Informahon Capsules, and Research Notes are being e-mailed to users in PDF format to facilitate 
distribution. The Institutional Research web page was created to provide quick, easy, user-friendly access 
to frequently requested data and information. An electronic factbook was included recently to provide a 
more complete picture of the College, accessible to anyone through the Internet. 



Methodology 

The current user survey builds on surveys administered in the past, but incorporates new items to capture 
input on some of the changes made by Institutional Research. A copy of the instrument is included in 
Appendix B. A reliability analysis using Cronbach's coefficient alpha was conducted on the Likert scaled 
items and the instrument was determined to be very reliable (r = .94). 

Instead of sending the survey in hard copy format to a selected distribution, as in the past, the current 
survey was conducted on-line using a Front Page form. Responses were saved to a text file, then 
imported and analyzed using PC-SAS. An e-mail message requesting participation, including a direct link 
to the survey, was sent to all employees with e-mail addresses at the College through a college-wide 
distribution list (3,498 addresses). 

While the response rate was only about 9%, this method resulted in 332 responses, more than in any 
previous user satisfaction survey conducted by Institutional Research. Many of the individuals receiving 
the e-mail message were unfamiliar with Institutional Research services and publications to date. It is 
hoped that this survey method achieved the goal of gathering feedback from as many users as possible, 
with the added benefit of increasing the visibility of the office for those who had not used Institutional 
Research services. 



Results 



Who responded to the survey ? 

Table 1 displays the self-reported job role of the survey respondents and Table 2 displays the self- 
reported areas of responsibility of survey respondents. The highest proportion of survey responses were 
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received by staff (42%), followed by management (31%) and faculty (22%). Among full-time personnel at 
M-DCC, faculty comprise 30%, management represent 17%, and classified staff comprise 53%. Using 
this as a guide, management personnel were much more likely to have responded to the survey, while 
faculty and staff response rates were somewhat lower than expected. 

Student services was selected by twenty-nine percent of the survey respondents as their area of 
responsibility, and the same percentage indicated that their area was not one of the choices listed for this 
question. Twenty-two percent selected classroom, 14% selected academic affairs, and 5% selected 
business/finance as their area of responsibility. 

Which services are being used and by whom ? 

Respondents were most familiar with Institutional Research publications (134 or 40% indicated that they 
had received them) (Table 3). Thirty percent (101 respondents) indicated that they had visited the 
Institutional Research web site and 27% (90 respondents) had requested special information or research 
from the office. Survey respondents who were in management roles were most likely to say they had 
received Institutional Research publications (74%) and staff were least likely (21%). Survey respondents 
who were in management roles were also most likely to say they had visited the Institutional Research 
web site (53%), while faculty were least likely (16%). Finally, survey respondents who were in 
management roles were most likely to say they had requested special information or research (58%), and 
staff were least likely (12%). 

How did respondents rate institutionai Research pubiications ? 

Institutional Research publications were rated very highly by respondents who received them. Table 4 
presents agreement ratings for the survey items related to the publications by job role of respondent. 
Because a number of respondents were unable to rate the publications along some of the dimensions, an 
agreement rating for respondents who were able to rate the item is included for each. 

One hundred percent of the respondents who were able to rate the items agreed or strongly agreed that 
the publications report on issues and topics relevant to M-DCC, and are well written. The publications 
received a lower rating for their usefulness in decision-making (89% overall). Faculty indicated that the 
publications are less useful in decision-making (82% agreement rating) than management or staff 
respondents (91% and 88% agreement ratings, respectively). 

Many of the items in this section appeared on the 1991 and 1994 surveys, but the response scale was 
different, making direct comparisons problematic. As mentioned previously. Institutional Research varied 
the format of the publications somewhat since the 1994 survey. It was hoped that these changes would 
result in publications that are easier to read and understand, more timely, and more useful to decision- 
makers. It does appear that the reports are more useful in decision-making. Eighty four percent of 
respondents in the 1994 surveys rated the usefulness of reports in decision-making as good or excellent. 
In the current survey, 89% of respondents who were able to rate the publications on this dimension 
agreed or strongly agreed that they were useful in decision-making. Other comparable items related to 
publications received consistent ratings across the 1994 and 2001 survey administrations. 

How did respondents rate the institutionai Research web site ? 

Table 5 presents agreement ratings for survey items related to the Institutional Research web site. The 
web site was rated highly by respondents and received the highest rating for accuracy (96% of 
respondents able to rate this dimension agreed or strongly agreed). The lowest rating was obtained for 
the item pertaining to information being current (89% agreed or strongly agreed, if able to rate). This 
rating has prompted Institutional Research to add information to each web page indicating date of last 
update and anticipating when new data will be available for posting. 

The number of respondents who indicated that they had visited the web site, and the ratings received for 
the site, suggest that this method of sharing routine information is well received by the College. 
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How did respondents rate the service provided by Institutional Research when reauestinp special 
information or research ? 

The agreement ratings for items related to special information or research requests are presented in 
Table 6. In general, users seem to be very satisfied with the service Institutional Research provides in 
response to their requests. In particular, the service was rated very highly for being understandable 
(100% of respondents who were able to rate the service agreed or strongly agreed) and timely (99% 
agreed or strongly agreed). The item receiving the lowest rating was ‘suggests alternative if unable to 
provide needed service' (94% agreed or strongly agreed). 

Although many of these items were included in the 1991 and 1994 surveys very few respondents 
completed these items in the past (32 and 27 responses, respectively). Comparisons with previous 
surveys are not made for this reason, as one or two dissatisfied respondents can alter the overall ratings 
noticeably. However, based on the number of respondents in the current survey who indicated that they 
had requested special information (90 respondents), it is evident that the volume of special requests has 
increased. Requesting special information has become almost as routine as receiving publications from 
Institutional Research (134 respondents received publications). 

As mentioned previously. Institutional Research has attempted to be more responsive to the immediate 
needs of the College by being available to fill special requests for information. By placing routine 
information on the web, staff have more time available for special requests. By having a campus liaison 
for research, the office has become more visible and accessible to the College community. It appears 
that these strategies are achieving the results for which they were intended. 

What did users think institutionai Research does weii ? 

Users were asked to comment on what Institutional Research does well. Almost a hundred comments 
were received noting a variety of strengths. Recurring themes were identified in the comments and 
characterized as “information resource,” “reports and publications,” “customer service,” and “contribution 
to the College.” 

The “information resource” theme was the most common. It appears that Institutional Research is 
recognized among its users as an excellent source for information. Respondents frequently cited specific 
examples of information they needed and obtained quickly for grant applications or reports. Sample 
comments from this category include: 

“They have a lot of knowledge about everything that relates to the college and the students.” 

“Statistics used to prepare external funding proposals; demographics describing student 
populations; assessment of M-DCC's effectiveness in re. CLAST success. . .” 

“Provide accurate statistical information about our student population.” 

"IR provides useful and expert information upon request.” 

“I believe that IR responds well when requests are made with little notice. The staff are always 
willing to offer assistance.” 



“Reports and publications” also received many comments from respondents. Institutional Research 
was commended for providing a variety of reports, written in such a way as to be understandable by the 
users. Sample comments from this category include: 

“The reports are timely and informational. They are presented in a format that is easy to 
understand and use.” 
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“Clear, concise research." 

“Most reports are easy to read and informative. Certain ‘high priority’ reports have been 
completed in record time." 

“The reports are informative and useful in determining issues that need to be addressed at the 
College.” 

A strong “customer service” orientation by Institutional Research personnel was noted in many of the 
comments. Sample comments from this category include: 

“Dr. Catherine Morris and her staff are very professional, competent and caring.” 

“You guys are always there when needed.” 

“...especially the staff that thinks outside the box and comes up with alternative ways to get the 
info requested....” 

The final theme that emerged was “contribution to the College.” Many comments noted the usefulness 
of Institutional Research reports and presentations in College planning and decision-making. Sample 
comments from this category include: 

“Provides data useful for the programs to make informed decisions.” 

“I am very grateful to IR for their instrumental role and support in College-related documentation.” 

“...assistance in developing Institutional Effectiveness grids/measures for administrative areas.” 

In what areas did respondents believe Institutional Research could improve ? 

Respondents were asked to comment on how they believed Institutional Research could improve its 
services. The comments were reviewed and several themes emerged: “visibility and distribution,” “web 
enhancements,” “focus of research and reports," “planning and interaction with College,” and “specific 
research suggestions." 

As mentioned previously, this survey was sent to the entire College e-mail distribution rather than to 
individuals on the report distribution list as in past surveys. Apparently, a number of recipients were 
unfamiliar with Institutional Research, so it is no surprise that a very common area for improvement would 
be “visibility and distribution.” Respondents suggested that Institutional Research find ways to make 
the College community more aware of the services provided and to distribute reports and capsules to a 
wider audience. Institutional Research will consider ways to do this. Sample comments from this 
category include: 

“More information should be provided to the College Community about IR and its services.” 

“...getting more information out to the College population about its services and its publications 
should be a bigger priority. The info is not getting to support staff adequately, for example.” 

“Design seminars on each campus, including Hialeah Center to inform faculty and staff about 
services and possible projects.” 

“...providing research reports to more interested groups of employees such as Academic 
Advisors and Intervention Specialists... .it would be helpful if we were on the direct ‘mailing list’.” 

Many specific suggestions were offered about “web enhancements.” A number of respondents 
suggested that the web site should be kept up-to date. Institutional Research strives to keep the 
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information as up-to-date as possible. Some statistics, particularly state and national comparisons are 
provided by external agencies and may not be as current as M-DCC statistics generated by Institutional 
Research. Institutional Research will provide better notations on web pages indicating date of most recent 
update, and when new information is anticipated. 

Additional sample comments from the ‘web enhancements” category include: 

“I was going to recommend that you put the full reports on the web, but I noticed that is now being 
done. 1) I think it might be beneficial to have past reports put on there as well. 2) Perhaps you 
could add a search feature ....” Institutional Research is currently working on putting full text of 
past reports on the web. 

“Provide a search engine within the Institutional Research/Testing web page.” Institutional 
Research looked into search engines and determined that the College web site search engine will 
serve this purpose. The College search engine links to Institutional Research web pages. Users 
need to simply type in the key words of interest. 

“The basic data should be annualized if possible even though semester or partial year data may 
be available.” Institutional Research is in the process of adding term/annual enrollment data by 
campus/center to the web. 

Several suggestions were made concerning the “focus of research and reports,” most requesting 
additional level of detail as in program, school or department level statistics. Sample comments from this 
category include: 

“We could use more information on the campus alone concerning such issues as financial aid 
and students on plus ethnicity.” Institutional Research handles most requests for specific 
information on an individual basis. Financial aid disbursements are being added to our data files 
and this information will be added to our web site. 

“When you publish the report for Vocational and Non-credit courses, you should separate these 
two categories as they are no longer the same department.” Institutional Research will be 
separating the vocational and various categories of non-credit enrollment in the next annual 
profile. These areas are already separated on our web site and will be separated in enrollment 
monitoring beginning Fall 2001. 

“Perhaps not improve as much as have the ability to provide more program specific assistance.” 
Program specific data have been provided through special information requests. Institutional 
Research will explore ways to make program managers more aware of this service. 

“More specific info on the Schools would be helpful.” Institutional Research will work with the 
School Directors to explore ways to provide school level data in the most meaningful format. 

Some of the comments in the “planning and interaction with the College” category suggested that 
Institutional Research work more closely with people at the department, program or campus level to 
frame research and provide useful information. Other comments pertained to interpreting results of the 
research. The following comments are examples of this type: 

“Ask Departments what kinds of data questions would allow them to operate more effectively.” 
Institutional Research will ask the Academic Deans and Discipline Chairs for suggestions on data 
needs. 

“Help us a bit with the conclusions, or extrapolation, to our population.” Institutional Research will 
be adding ‘conclusions’ to reports and capsules whenever appropriate’. 
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“Be a little more proactive in putting together useful and helpful information on enrollees, CLAST 
results, etc. Don’t wait to be asked.” Institutional Research will explore ways to better anticipate 
the research needs of the College. 

A number of comments were received offering “specific research suggestions.” Some of the requests 
received include the following: 

“Staffing issues need to get more focus, as well as the major changes in faculty demographics 
with the greater and greater emphasis on adjuncts. Some emphasis also on the benefits of 
technology and impact on courses, faculty, staff, students and administration. More study of the 
end products of the M-DCC system - the graduates.” Institutional Research will be doing a 
Graduate Survey this year and will explore the other suggestions with areas of the College that 
manage these data. 

“More information on performance-based results, and suggestions for improvement at the 
College.” Institutional Research is currently preparing a capsule update on the College’s 
Performance Based Budgeting allocation for 2001-02. 

“Development of marketing/enrollment management data to facilitate program evaluation and 
development.” Institutional Research will be working closely with the Enrollment Management 
Initiative at the College to address information needs. 

“I’d like to see more academic research. Are programs/courses effective? What happens to 
students who complete college prep, but can’t pass the college prep exit test? How many 
students complete EAP/ESL but need college prep ...” The research agenda provided to 
Institutional Research by the Academic Deans included items related to this comment. Research 
Notes, Capsules, and Reports related to some of these specific suggestions can be found on the 
web (see Information Capsule 2000-09C, Research Note 1/2/2001, Research Note 3/2/2001, and 
Information Capsule 2001 -01 C for example). 



Institutional Research is very pleased with the number of survey responses received and with the 
excellent feedback obtained. Results were ovenwhelmingly favorable for all three areas of service - 
publications, web site, and special research requests. We plan to address suggestions for improvement 
as noted above, but believe that the survey results indicate that the office is achieving the positive results 
expected in the role of information resource. Thank you to everyone who responded to the survey and 
welcome to the new users of Institutional Research services. 
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Table 1 

Survey Respondents by Job Role 



Role 


Number 


Percent 


Management 


102 


31% 


Faculty 


73 


22% 


Staff 


139 


42% 


Other 


18 


5% 


Total 


332 


100% 



Table 2 

Survey Respondents by Area of Responsibility 



Responsibility 


Number 


Percent 


Academic Affairs 


47 


14% 


Classroom 


74 


22% 


Student Services 


96 


29% 


Business/Finance 


18 


5% 


Other 


97 


29% 


Total 


332 


100% 



Table 3 



Use of Services by Job Role of Survey Respondents 







Received Publications 


Visited IR Web 


Requested 
Special Information 


Role 


Number 


Yes 


Percent 


Yes 


Percent 


Yes 


Percent 


Management 


102 


75 


74% 


54 


53% 


59 


58% 


Faculty 


73 


25 


34% 


12 


16% 


12 


16% 


Staff 


139 


29 


21% 


28 


20% 


16 


12% 


Other 


18 


5 


28% 


7 


39% 


3 


17% 


Total 


332 


134 


40% 


101 


30% 


90 


27% 
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“Mhiiiii-Dade j, 
C omni miit y Golle ge 



% V 

‘ ±«y' 






1 Institutional Rescfai Gn 



Institutional Research 
Survey of Satisfaction with Services 



What is your role at M-DCC? 



What is your area of responsibility? 



C Management 
C Faculty 
O Staff 
r Other 



C Academic Affairs 
C Classroom 
C Student Services 
C Business & Finance 
C Other 



Section I. Publications 

Institutional Research publishes information in a variety of formats - research reports, 
information capsules, research notes, fact sheets, etc. Please answer the following 
questions about IR publications. 



to M-DCC. 



Have you received any IR publications? 
C Yes 

C No (if no, please skip to Section ID 

Institutional Research publications... 

’*■ report on issues and topics relevant 
C Strongly agree C Agree 

* are distributed in a timely fashion. 

O Strongly agree C Agree 

* are useful in decision-making. 

C Strongly agree C Agree 

* are well written. 

C Strongly agree O Agree 

* are easy to understand. 

C Strongly agree C Agree 

* are interesting and informative. 

G Strongly agree C Agree 

* are accurate. 

O Strongly agree C Agree 

* are objective. 

G Strongly agree G Agree 



O 




G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 


G Disagree 


G Strongly disagree 


G Unable to rate 



22 



40 
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IR Survey 

Section II. Web Site 

Institutional Research maintains a web site ( www.mdcc.edu/mdcc/ir l that contains statistics on 
student enrollment and demographics, publication summaries, information on testing 
requirements, etc. Please answer the following questions about IR web site. 

‘ Have you visited the Institutional Research web site? 

C Yes 

C No (if no, please skip to Section 110 

The information on Institutional Research's web site is... 



* frequently needed. 



C Strongly agree 


C Agree 


C Disagree 


C Strongly disagree 


C Unable to rate 


easy to access. 

C Strongly agree 


C Agree 


O Disagree 


C Strongly disagree 


C Unable to rate 


* accurate. 

C Strongly agree 


C Agree 


C Disagree 


C Strongly disagree 


C Unable to rate 


* current. 

r Strongly agree 


C Agree 


C Disagree 


C Strongly disagree 


C Unable to rate 


* comprehensive. 

C Strongly agree 


C Agree 


C Disagree 


O Strongly disagree 


O Unable to rate 



Section III. Special Requests 

Institutional Research responds to many special requests for information, research, and 
evaluation, assistance. Please answer the following questions about Institutional Research's 
response to special information requests. 



Have you requested special information or research from Institutional Research? 



O Yes 

O No (if no, please skip to Section IV l 



Institutional Research. 




staff are helpful. 

C Strongly agree 


C Agree 


C Disagree 


C Strongly disagree 


O Unable to rate 


staff are knowledgeable. 
C Strongly agree 


C Agree 


r Disagree 


C Strongly disagree 


C Unable to rate 



* provides the special information needed. 

C Strongly agree C Agree C Disagree C Strongly disagree C Unable to rate 

* provides the research assistance needed. 

C Strongly agree O Agree C Disagree O Strongly disagree C Unable to rate 

* suggests alternative if unable to provide needed service. 

O Strongly agree O Agree C Disagree 0 Strongly disagree C Unable to rate 

* responds within a reasonable amount of time to special requests. 
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C Strongly agree C Agree C Disagree C. Strongly disagree Unable to rate 

* provides information and assistance that is understandable. 

C Strongly agree C Agree O Disagree C Strongly disagree Unable to rate 

Section IV. Comments 



What do you think Institutional Research does well? 




In what areas do you think Institutional Research could improve? 




ISubmit 



Reset 
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